2025-07-13 01:25:38,456 [ 50432 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-07-13 01:25:38,457 [ 50432 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-07-13 01:25:38,457 [ 50432 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-07-13 01:25:38,457 [ 50432 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_gfmswz --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_catboost_evaluate/test.py::testAmazonModelManyRows test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_config_decryption/test_wrong_settings.py::test_invalid_chars test_access_control_on_cluster/test.py::test_access_control_on_cluster test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_database_delta/test.py::test_complex_table_schema test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_distributed_format/test.py::test_remove_replica test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] [gw6] [ 1%] PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key [gw5] [ 2%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] [gw8] [ 3%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw6] [ 4%] PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes [gw4] [ 5%] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster [gw4] [ 6%] PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster [gw8] [ 7%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml [gw4] [ 8%] PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster [gw5] [ 9%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] [gw8] [ 10%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw8] [ 11%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw0] [ 12%] PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration [gw0] [ 13%] PASSED test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas [gw0] [ 14%] PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_dependency_xml/test.py::test_dependent_tables [gw6] [ 15%] PASSED test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method [gw1] [ 16%] PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow [gw1] [ 17%] PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString [gw8] [ 18%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw1] [ 19%] PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures [gw5] [ 20%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] [gw1] [ 21%] PASSED test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric [gw1] [ 22%] PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath [gw1] [ 23%] PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath [gw1] [ 24%] PASSED test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] [gw7] [ 25%] PASSED test_distributed_format/test.py::test_remove_replica test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] [gw1] [ 26%] PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate [gw1] [ 27%] PASSED test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures [gw5] [ 28%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] [gw6] [ 29%] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method test_default_compression_codec/test.py::test_default_codec_for_compact_parts [gw1] [ 30%] PASSED test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures [gw1] [ 31%] PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures [gw1] [ 32%] PASSED test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash [gw0] [ 33%] PASSED test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries [gw0] [ 34%] PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl [gw0] [ 35%] PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load [gw3] [ 36%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes [gw0] [ 37%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node [gw8] [ 38%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw0] [ 39%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key [gw0] [ 40%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema [gw0] [ 41%] PASSED test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw4] [ 42%] PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data [gw1] [ 43%] PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh [gw5] [ 44%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] [gw1] [ 45%] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments [gw0] [ 46%] PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw8] [ 47%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw7] [ 48%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] [gw1] [ 49%] PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments [gw2] [ 50%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_backward_compatibility/test_functions.py::test_aggregate_states test_backup_restore_keeper_map/test.py::test_on_cluster[0] [gw6] [ 51%] PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple [gw5] [ 52%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] [gw6] [ 53%] PASSED test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single [gw4] [ 54%] PASSED test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name [gw7] [ 55%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] [gw4] [ 56%] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_create_query_constraints/test.py::test_create_query_const_constraints [gw5] [ 57%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] [gw3] [ 58%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] [gw7] [ 59%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] [gw1] [ 60%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw4] [ 61%] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw5] [ 62%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw2] [ 63%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] [gw4] [ 64%] PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw6] [ 65%] PASSED test_default_compression_codec/test.py::test_default_codec_single test_broken_part_during_merge/test.py::test_merge_and_part_corruption [gw7] [ 66%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] [gw8] [ 67%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] test_backup_restore_keeper_map/test.py::test_on_cluster[1] test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields [gw0] [ 68%] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions [gw0] [ 69%] SKIPPED test_backward_compatibility/test_functions.py::test_string_functions test_always_fetch_merged/test.py::test_replica_always_download [gw4] [ 70%] PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption [gw7] [ 71%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw1] [ 72%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw2] [ 73%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] [gw0] [ 74%] PASSED test_always_fetch_merged/test.py::test_replica_always_download test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw8] [ 75%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] test_async_insert_memory/test.py::test_memory_usage [gw7] [ 76%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] [gw2] [ 77%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] [gw1] [ 78%] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_config_yaml_full/test.py::test_yaml_full_conf [gw4] [ 79%] PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw1] [ 80%] PASSED test_config_yaml_full/test.py::test_yaml_full_conf [gw3] [ 81%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] [gw6] [ 82%] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw2] [ 83%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] [gw2] [ 84%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] [gw2] [ 85%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw3] [ 86%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] [gw2] [ 87%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw5] [ 88%] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw8] [ 89%] PASSED test_async_insert_memory/test.py::test_memory_usage test_config_corresponding_root/test.py::test_work [gw5] [ 90%] PASSED test_config_corresponding_root/test.py::test_work test_distributed_default_database/test.py::test_query [gw5] [ 91%] PASSED test_distributed_default_database/test.py::test_query [gw3] [ 92%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] [gw3] [ 93%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] [gw3] [ 94%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw3] [ 95%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw3] [ 96%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw6] [ 97%] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw9] [ 98%] ERROR test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables [gw9] [ 99%] ERROR test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables [gw9] [100%] ERROR test_database_delta/test.py::test_multiple_schemes_tables ==================================== ERRORS ==================================== _________________ ERROR at setup of test_complex_table_schema __________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 17076 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ~~~~~~~~~~~~~~~~~~~~~ Stack of (140227033916992) ~~~~~~~~~~~~~~~~~~~~~ File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 411, in _perform_spawn reply.run() File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 341, in run self._result = func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 1160, in _thread_receiver msg = Message.from_io(io) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 567, in from_io header = io.read(9) # type 1, channel 4, payload 4 File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 534, in read data = self._read(numbytes - len(buf)) ---------------------------- Captured stderr setup ----------------------------- Command:[docker ps | wc -l] Stdout:1 No running containers Pruning Docker networks Command:[docker network prune --force] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 8ea85e7ba1f3 ENV SHLVL 0 ENV HOME /root ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 5ccda723c1fc ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 ENV PYTEST_XDIST_TESTRUNUID 6c781691982a4a9b971eef791c488d9d ENV PYTEST_XDIST_WORKER gw9 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Running tests in /ClickHouse/tests/integration/test_database_delta/test.py Cluster start called. is_up=False Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for common tests configuration Copy common configuration from helpers Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Failed to start cluster: Timeout >900.0s Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 ------------------------------ Captured log setup ------------------------------ 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2025-07-13 01:25:44 [ 720 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker network prune --force] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:145, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV HOSTNAME 8ea85e7ba1f3 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV SHLVL 0 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV HOME /root (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV OLDPWD / (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV TZ Etc/UTC (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV DOCKER_BASE_TAG 5ccda723c1fc (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 6c781691982a4a9b971eef791c488d9d (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTEST_XDIST_WORKER gw9 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) (cluster.py:419, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:719, __init__) 2025-07-13 01:25:44 [ 720 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-07-13 01:25:44 [ 720 ] DEBUG : Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-07-13 01:25:44 [ 720 ] INFO : Starting cluster... (test.py:42, started_cluster) 2025-07-13 01:25:44 [ 720 ] INFO : Running tests in /ClickHouse/tests/integration/test_database_delta/test.py (cluster.py:2672, start) 2025-07-13 01:25:44 [ 720 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:25:44 [ 720 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 01:25:44 [ 720 ] DEBUG : Setup directory for instance: node1 (cluster.py:2692, start) 2025-07-13 01:25:44 [ 720 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d (cluster.py:4649, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database (cluster.py:4666, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs (cluster.py:4677, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-13 01:25:44 [ 720 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env (cluster.py:96, _create_env_file) 2025-07-13 01:25:44 [ 720 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 01:25:44 [ 720 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 01:25:44 [ 720 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 01:25:44 [ 720 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 01:25:44 [ 720 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-13 01:25:44 [ 720 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:30:44 [ 720 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 01:30:47 [ 720 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:35:47 [ 720 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 01:35:49 [ 720 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:40:44 [ 720 ] DEBUG : Failed to start cluster: (cluster.py:3091, start) 2025-07-13 01:40:44 [ 720 ] DEBUG : Timeout >900.0s (cluster.py:3092, start) 2025-07-13 01:40:44 [ 720 ] DEBUG : Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s (cluster.py:3093, start) 2025-07-13 01:40:44 [ 720 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:40:44 [ 720 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:40:44 [ 720 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:40:44 [ 720 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:40:44 [ 720 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:40:44 [ 720 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:40:44 [ 720 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:40:44 [ 720 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:40:44 [ 720 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:40:44 [ 720 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:40:44 [ 720 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 01:40:45 [ 720 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:40:45 [ 720 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:40:45 [ 720 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:40:45 [ 720 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:40:45 [ 720 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:40:45 [ 720 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:40:45 [ 720 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) _____________ ERROR at setup of test_embedded_database_and_tables ______________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 17076 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ________________ ERROR at setup of test_multiple_schemes_tables ________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 17076 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ----------------- generated report log file: parallel0_0.jsonl ----------------- ============================== slowest durations =============================== 900.82s setup test_database_delta/test.py::test_complex_table_schema 542.79s setup test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 288.40s setup test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 226.54s call test_async_insert_memory/test.py::test_memory_usage 138.92s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 130.25s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 122.35s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 122.03s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 120.62s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 76.20s call test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 55.89s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 55.88s call test_backward_compatibility/test_functions.py::test_aggregate_states 53.14s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 50.31s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 49.03s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 48.45s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 48.43s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 45.36s call test_backup_restore_keeper_map/test.py::test_on_cluster[1] 44.87s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 43.38s call test_backup_restore_keeper_map/test.py::test_on_cluster[0] 42.93s call test_default_compression_codec/test.py::test_default_codec_single 40.95s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 40.29s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 36.58s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 34.77s call test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 27.15s call test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 27.00s call test_distributed_format/test.py::test_remove_replica 26.83s call test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 25.38s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 24.27s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 24.02s call test_dictionaries_dependency_xml/test.py::test_get_data 23.84s setup test_catboost_evaluate/test.py::testAmazonModelManyRows 23.42s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 23.40s setup test_distributed_format/test.py::test_remove_replica 23.33s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 22.60s setup test_access_control_on_cluster/test.py::test_access_control_on_cluster 22.59s setup test_default_compression_codec/test.py::test_default_codec_for_compact_parts 22.58s call test_distributed_default_database/test.py::test_query 22.17s setup test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 21.21s setup test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 20.77s call test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 20.76s call test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 20.73s call test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 20.54s call test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 20.40s setup test_broken_part_during_merge/test.py::test_merge_and_part_corruption 20.29s call test_config_yaml_full/test.py::test_yaml_full_conf 20.06s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 19.59s setup test_backward_compatibility/test_functions.py::test_aggregate_states 19.25s setup test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 19.09s teardown test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 18.53s setup test_create_query_constraints/test.py::test_create_query_const_constraints 18.37s setup test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 18.36s call test_catboost_evaluate/test.py::testAmazonModelManyRows 18.26s setup test_backup_restore_keeper_map/test.py::test_on_cluster[0] 18.24s call test_dictionaries_postgresql/test.py::test_invalidate_query 17.77s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 16.90s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 16.20s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 15.69s call test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 15.57s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 15.49s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 15.20s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 15.07s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 14.88s teardown test_default_compression_codec/test.py::test_default_codec_single 14.87s setup test_dictionaries_dependency_xml/test.py::test_dependent_tables 14.82s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 14.30s call test_config_decryption/test_wrong_settings.py::test_invalid_chars 13.90s call test_config_decryption/test_wrong_settings.py::test_subnodes 13.74s call test_config_decryption/test_wrong_settings.py::test_no_encryption_key 13.18s setup test_always_fetch_merged/test.py::test_replica_always_download 12.93s setup test_config_corresponding_root/test.py::test_work 12.54s call test_always_fetch_merged/test.py::test_replica_always_download 12.13s call test_config_decryption/test_wrong_settings.py::test_wrong_method 11.71s call test_dictionaries_dependency_xml/test.py::test_dependent_tables 11.63s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 11.13s call test_catboost_evaluate/test.py::testRecoveryAfterCrash 11.05s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 10.32s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 10.07s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 9.55s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 9.35s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 9.32s call test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 9.31s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 9.26s call test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 8.92s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 8.89s teardown test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 8.54s call test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 8.39s setup test_async_insert_memory/test.py::test_memory_usage 8.35s call test_default_compression_codec/test.py::test_default_codec_multiple 6.71s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 6.53s teardown test_broken_part_during_merge/test.py::test_merge_and_part_corruption 6.31s teardown test_async_insert_memory/test.py::test_memory_usage 6.28s call test_access_control_on_cluster/test.py::test_access_control_on_cluster 6.25s call test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 6.17s teardown test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 6.14s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 6.04s call test_broken_part_during_merge/test.py::test_merge_and_part_corruption 5.65s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 5.62s teardown test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 5.53s teardown test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 5.40s teardown test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 5.38s call test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 5.37s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 5.28s teardown test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 4.97s teardown test_always_fetch_merged/test.py::test_replica_always_download 4.53s call test_create_query_constraints/test.py::test_create_query_minmax_constraints 4.27s teardown test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 4.07s call test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 3.96s call test_create_query_constraints/test.py::test_create_query_const_constraints 3.96s call test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 3.44s call test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 3.32s teardown test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 3.09s teardown test_backward_compatibility/test_functions.py::test_string_functions 3.08s call test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 3.03s call test_default_compression_codec/test.py::test_default_codec_for_compact_parts 2.83s call test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 2.82s call test_dictionaries_postgresql/test.py::test_load_dictionaries 2.68s call test_catboost_evaluate/test.py::testModelPathIsNotAConstString 2.61s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[1] 2.58s teardown test_create_query_constraints/test.py::test_create_query_minmax_constraints 2.53s call test_access_control_on_cluster/test.py::test_grant_all_on_cluster 2.07s call test_catboost_evaluate/test.py::testNonConstantFeatures 2.05s teardown test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.96s call test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 1.75s call test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 1.64s call test_catboost_evaluate/test.py::testModelUpdate 1.59s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 1.58s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 1.56s teardown test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 1.39s call test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.25s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 1.16s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 1.14s call test_dictionaries_postgresql/test.py::test_postgres_schema 1.11s call test_catboost_evaluate/test.py::testInvalidLibraryPath 1.11s call test_catboost_evaluate/test.py::testOnNullableFeatures 1.10s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 1.09s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 1.07s call test_catboost_evaluate/test.py::testInvalidModelPath 0.95s call test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.94s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.90s call test_catboost_evaluate/test.py::testConstantFeatures 0.88s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.86s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.86s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.85s call test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.85s call test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.85s call test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.80s call test_dictionaries_postgresql/test.py::test_bad_configuration 0.79s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.78s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.78s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.73s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.70s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.69s teardown test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.64s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.33s call test_backward_compatibility/test_functions.py::test_string_functions 0.32s call test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.04s setup test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.01s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 0.00s setup test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s setup test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s setup test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s teardown test_distributed_format/test.py::test_remove_replica 0.00s teardown test_catboost_evaluate/test.py::testAmazonModelManyRows 0.00s teardown test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 0.00s teardown test_access_control_on_cluster/test.py::test_access_control_on_cluster 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.00s teardown test_config_yaml_full/test.py::test_yaml_full_conf 0.00s setup test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s teardown test_database_delta/test.py::test_embedded_database_and_tables 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s teardown test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s setup test_backup_restore_keeper_map/test.py::test_on_cluster[1] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s teardown test_distributed_default_database/test.py::test_query 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s teardown test_backward_compatibility/test_functions.py::test_aggregate_states 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.00s setup test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s setup test_config_yaml_full/test.py::test_yaml_full_conf 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 0.00s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.00s teardown test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s setup test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s teardown test_database_delta/test.py::test_complex_table_schema 0.00s setup test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[0] 0.00s setup test_create_query_constraints/test.py::test_create_query_minmax_constraints 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.00s teardown test_catboost_evaluate/test.py::testConstantFeatures 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.00s teardown test_dictionaries_dependency_xml/test.py::test_dependent_tables 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.00s setup test_default_compression_codec/test.py::test_default_codec_multiple 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s teardown test_default_compression_codec/test.py::test_default_codec_for_compact_parts 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s setup test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.00s setup test_dictionaries_dependency_xml/test.py::test_get_data 0.00s setup test_default_compression_codec/test.py::test_default_codec_single 0.00s setup test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 0.00s setup test_distributed_default_database/test.py::test_query 0.00s teardown test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s setup test_catboost_evaluate/test.py::testConstantFeatures 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s teardown test_default_compression_codec/test.py::test_default_codec_multiple 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 0.00s setup test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s teardown test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s setup test_database_delta/test.py::test_embedded_database_and_tables 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.00s setup test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s teardown test_database_delta/test.py::test_multiple_schemes_tables 0.00s teardown test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.00s teardown test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 0.00s teardown test_catboost_evaluate/test.py::testInvalidModelPath 0.00s teardown test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s call test_config_corresponding_root/test.py::test_work 0.00s teardown test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s setup test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s setup test_catboost_evaluate/test.py::testModelUpdate 0.00s teardown test_create_query_constraints/test.py::test_create_query_const_constraints 0.00s setup test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s setup test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 0.00s setup test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s setup test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s teardown test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s teardown test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s setup test_catboost_evaluate/test.py::testInvalidModelPath 0.00s teardown test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s teardown test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s setup test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s setup test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 0.00s teardown test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s teardown test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s setup test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s teardown test_dictionaries_dependency_xml/test.py::test_get_data 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s teardown test_config_corresponding_root/test.py::test_work 0.00s setup test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s teardown test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s setup test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 0.00s setup test_backward_compatibility/test_functions.py::test_string_functions 0.00s teardown test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s teardown test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s setup test_database_delta/test.py::test_multiple_schemes_tables 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s setup test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 0.00s teardown test_catboost_evaluate/test.py::testModelUpdate 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s teardown test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s teardown test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s teardown test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s teardown test_access_control_on_cluster/test.py::test_grant_all_on_cluster =========================== short test summary info ============================ ERROR test_database_delta/test.py::test_complex_table_schema - Failed: Timeou... ERROR test_database_delta/test.py::test_embedded_database_and_tables - Failed... ERROR test_database_delta/test.py::test_multiple_schemes_tables - Failed: Tim... PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect PASSED test_dictionaries_postgresql/test.py::test_bad_configuration PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas PASSED test_config_decryption/test_wrong_settings.py::test_subnodes PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] PASSED test_catboost_evaluate/test.py::testConstantFeatures PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath PASSED test_catboost_evaluate/test.py::testInvalidModelPath PASSED test_distributed_format/test.py::test_remove_replica PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString PASSED test_catboost_evaluate/test.py::testModelUpdate PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method PASSED test_catboost_evaluate/test.py::testNonConstantFeatures PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures PASSED test_catboost_evaluate/test.py::testOnNullableFeatures PASSED test_dictionaries_postgresql/test.py::test_invalidate_query PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key PASSED test_dictionaries_postgresql/test.py::test_postgres_schema PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] PASSED test_default_compression_codec/test.py::test_default_codec_multiple PASSED test_dictionaries_dependency_xml/test.py::test_get_data PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints PASSED test_default_compression_codec/test.py::test_default_codec_single PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] PASSED test_always_fetch_merged/test.py::test_replica_always_download PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts PASSED test_config_yaml_full/test.py::test_yaml_full_conf PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication PASSED test_async_insert_memory/test.py::test_memory_usage PASSED test_config_corresponding_root/test.py::test_work PASSED test_distributed_default_database/test.py::test_query PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability SKIPPED [1] test_backward_compatibility/test_functions.py:164: The test is slow in builds with sanitizer ============= 96 passed, 1 skipped, 3 errors in 904.06s (0:15:04) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_gfmswz --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.